Skip to main content

Reply to this post | See parent post | Go Back
View Post [edit]

Poster: jonc Date: Aug 7, 2011 6:39pm
Forum: web Subject: Re: robots.txt

You'll be better off starting a new thread instead replying to one two years old. The old threads get buried and won't be seen by anybody casually browsing the forums.

It takes a few months to crawl the entire Web, so it might be a while before your site is archived. You'll just have to be patient.